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5 APPLIANCE COMMUNICATION SYSTEM AND METHOD 

BACKGROUND OF THE INVENTION 

10 The present invention relates generally to appliances, and more particularly to a method 

and system for communicating with an intelligent appliance. 

Appliances, such as ovens and refrigerators, are capable of carrying out limited user 

defined instructions that are specified locally. Such instructions typically include start time, 

temperature, and duration. More remote user defined instructions are rarely, if ever, input into 
15 the appliance. A standard appliance, such as a refiigerator or oven, contains and uses the most 

basic of electrical control components, ranging fi-om thermocouples, thermostats to cooling fans. 

The more complex appliances on occasion include limited microprocessor control systems. 

However, the control systems are not designed to carry out detailed instructions or allow control 

fi-om a remote location. 

20 Complex appliances are suitably capable of interaction and communication with other 

local appliances. However, such interaction is limited to those other appliances connected to the 
user's personal computer. Even the complex appliances lack the ability for direct 
communications, but rather use an exterior device of some sort, such as a computer, capable of 
interfacing with the appliance. The interfacing device is normally the user's personal computer, 

25 on which a software application provides the appliance with control and instruction. The 
personal computer also allows for the user to connect from a remote location via the Internet 
with his or her computer and instruct the computer to have the oven begin cooking at a set time, 
or pause cooking or cancel cooking. The intelligence, that is the communication controls, for the 
appliances are therefore not located on the appliance itself, but rather a personal computer 

30 fiinctioning much like a server with each appliance being a networked client. 

However, even in these advanced appliances, there is no ability to directly connect with 
the Intemet for command or control purposes. Rather, the appliance makes use of either a local 
personal computer or some other means of connecting to the Intemet. In essence, a server is 
required, ancillary to the appliance, which functions as a bridge between the Intemet and the 
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appliance. Such an appliance does not incorporate an intelligence module, capable of directly 
interfacing with the Internet. Thus the current appUances lack integrated means for connecting 
with a user outside a local area. 

Thus there exists a need for a system that combines the capability of a classic residential 
5 or commercial appliance with the ability to directly interface with a user at a remote location. 
Furthermore, there exists the need for a method to access an intelligent appliance from a remote 
location. 
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SUMMARY OF THE INVENTION 



In view of the aforementioned needs, the invention contemplates a system and method for 
communicating with an inteUigent residential or conmiercial appliance. 
5 In accordance with the present invention, there is provided a system for conmiunicating 

with an intelligent appliance. The intelligent appliance suitably comprises an integrated 
controller for directing operations of the appliance, monitoring the appliance and controUing the 
appliance from outside the appliance. In one embodiment the integrated controller is a suitable 
single board computer capable of interfacing with a computer network. The appliance further 

10 comprises a user-interface, enabling a user to program the appliance. The system also comprises 
means for communicating with the Internet, which enables the appliance to communicate with 
external devices via the Internet. Various devices are suited to communicate with the appliance, 
including telephones, personal data assistants, remote computers and the like, using the 
integrated controller over the Intemet, directly with the controller via wireless connectivity, or 

15 via any suitable means. 

Further in accordance with the present invention, there is provided an intelligent 
appliance control system. The system comprises a data transport adapted to place an associated 
appliance in data communication with an associated remote user interface. The system includes 
means adapted for acquiring state information from the associated appliance. The state 

20 information represents at least one current or fixture state of the associated appUance. The system 
also includes means adapted for communicating the state information to the data interface. The 
state information is thereby made available for communication to the associated remote user 
interface. The data transport interface includes means for acquiring state change information 
received from the associated, non built-in user interface. The state change information 

25 represents an altered, desired state of the associated appliance. The system comprises means 
adapted for generating a state change signal representing the desired state of the associated 
appliance. The system fiirther comprises means adapted for communicating the state change 
signal to the associated appliance. 

Still fiirther in accordance with the present invention, there is provided a method for 

30 controlling an inteUigent apphance from a remote device. The remote device and the appliance 
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establish a connection over a suitable network. In the attempt to establish a connection, the 
remote device sends authentication information, identifying the user to the appUance. Once 
verified, the remote device transmits a message to the appliance. The appliance receives the 
message and operates according to a set of instructions contained within the message. The 
5 appliance is suitably equipped to provide updates on the status of cooking, cleaning, problems or 
the like. In another embodiment the appliance generates remote notifications or receives and 
understands voice commands. 

In one embodiment, the intelligent appliance comprises an integrated, single board 
computer, directing the operations of a user-interface, an electronic range control, and 

10 communications with external devices. The integrated, single board computer is suitably 
capable of performing range control functions without the need of a specific range control. 

In another embodiment, the intelligent appliance communicates with extemal devices via 
the Internet. In one aspect, the Internet is used to connect extemal devices to a remote server, 
the server providing access to the intelligent appHance. 

15 Still yet further in accordance with the present invention, there is provided an electronic 

messaging system for communicating between a residential or commercial appliance and a 
remote device. The system comprises means adapted for generating an electronic message to an 
appliance and means adapted for generating an electronic message to the remote user. The 
system further includes means adapted for editing the electronic message including allowing for 

20 the identification of a destination address. Means adapted for connecting a remote device with 
the appliance are also incorporated into the present system, as well as means adapted for 
transmitting information between the remote device and the appliance. 

In one embodiment, the system also comprises authenticating means adapted for 
verifying the identity of the remote device. The system is suitably equipped with means adapted 

25 for interpreting voice signals. 

Yet further in accordance with the present invention, there is provided a method for 
controlling an intelligent appliance. The method includes the step of acquiring state information 
from an associated appliance. The state information represents at least one current or future state 
of the associated appliance. The method also includes the step of communicating the state 

30 information to a data interface. The data interface is in communication with an associated 

remote user interface, enabling the state information to be made available for communication to 
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the associated remote user interface. The method further includes the step of acquiring state 
change information from the associated, non built-in user interface by the data interface. The 
state change information represents an altered, desired state of the associated appliance. The 
method also comprises the step of generating a state change signal representing the desired state 
5 of the associated appliance. The method also comprises the step of communicating the state 
change signal to the associated appliance. 

In one embodiment, the appUance is programmed to list all dishes stored in memory, 
create a new dish, modify an existing dish or delete a stored dish. Requests are formed by the 
remote device and dish information is collected. The dish information, along with commands, 
10 are transmitted to the appliance, thereafter listing, adding, modifying or deleting dishes. 

Li another embodiment, the remote device prompts a user for the Internet protocol 
address and port information of a selected appUance. Still another embodiment provides cooking 
instructions transmitted as the electronic message. 

These and other advantages, aspects, and features will be understood by one of ordinary 
15 skill in the art upon reading and luiderstanding the specification. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



It will be appreciated that the illustrated boundaries of elements (e.g. boxes, groups of 
boxes, or other shapes) in the figures represent one example of the boundaries. One of ordinary 
5 skill in the art will appreciate that one element is suitably designed as multiple elements or that 
multiple elements are suitably designed as one element. An element shown as an internal 
component of another element is suitably implemented as an extemal component and vice versa. 

Figure 1 is a system diagram of one embodiment of an intelligent appliance system and 
10 method;. 

Figure 2 is a system diagram of an alternate embodiment of an intelligent appliance 
system and method; 

Figures illustrates one embodiment of a methodology for the appliance discovery 
process in accordance with the present system and method; 
15 Figure 4 illustrates one embodiment of a methodology for the remote or chent side of the 

appUance discovery procedure in accordance with the present system and method; 

Figure 5a illustrates one embodiment of a methodology for the appUance side of the 
appliance waiting for broadcast discovery procedure in accordance with the present system and 
method; 

20 Figure 5b illustrates one embodiment of a methodology for the appliance side of the 

appliance waiting for connection discovery procedure in accordance with the present system and 
method; 

Figure 6 illustrates one embodiment of a methodology for the remote or client side of the 
appliance attaching procedure in accordance with the present system and method; 
25 Figure 7 illustrates one embodiment of a methodology for the remote or client side of the 

appliance command send procedure in accordance with the present system and method; 

Figure 8 illustrates one embodiment of a methodology for the appliance side of the 
appUance command send procedure in accordance with the present system and method; 

Figure 9 illustrates one embodiment of a methodology for the remote or client side of the 
30 appUance dish management procedure in accordance with the present system and method; 

Figure 10 illustrates one embodiment of a methodology for the appUance side of the 
appliance dish management procedure in accordance with the present system and method; 
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Figure 1 1 A illustrates one embodiment of a methodology for the remote or client side of 
the appliance program dish procedure in accordance with the present system and method; 

Figures 1 IB illustrates an alternate embodiment of a methodology for the remote or client 
side of the appliance program dish procedure using a probe component in accordance with the 
5 present system and method; 

Figure 12A illustrates one embodiment of a methodology for the appliance side of the 
appliance program dish procedure in accordance with the present system and method; 

Figure 12B illustrates an alternate embodiment of a methodology for the apphance side 
of the appliance program dish procedure using a probe component in accordance with the present 
10 system and method; 

Figure 13 illustrates one embodiment of a methodology for the remote or client side of 
the apphance status update procedure in accordance with the present system and method; 

Figure 14 illustrates one embodiment of a methodology for the appliance side of the 
appliance status update procedure in accordance with the present system and method; 
15 Figure 15 illustrates one embodiment of a methodology for the remote or client side of 

the appliance diagnostics procedure in accordance with the present system and method; 

Figure 16 illustrates one embodiment of a methodology for the appliance side of the 
appliance diagnostics procedure in accordance with the present system and method; and 

Figure 17 illustrates one embodiment of a methodology for the appliance voice control 
20 procedure in accordance with the present system and method. 



CLE 759595 J 
77414/33289 



-7. 



DETAILED DESCRIPTION OF PREFERRED AND ALTERNATE EMBODIMENTS 



Throughout this description, the preferred embodiment and examples shown should be 
considered as exemplars, rather than limitations, of the present invention. Briefly describing one 
5 embodiment of the present system and method, it provides a mechanism for a remote user to 
directly communicate with and control an intelligent residential or commercial appliance. It will 
be understood by those skilled in the art that the term remote, as used with reference the subject 
invention, is suitably interpreted to mean non-integrated to the appliance, i.e., not built-into the 
appliance. In other words, the system provides for an intelligent residential or commercial 

10 appliance, preferably a refrigerator-oven, having built-in network communications which is 
suitably delivered as wireless, power-line or direct network cabling. It will be appreciated that 
the envisioned intelligent appUance enables a user, through the method provided herein, to 
remotely use the intelligent appHance directly, without the necessity of using a proprietary 
network control system or personal computer acting in the capacity of a server. The skilled 

15 artisan will appreciate that direct communications between a user and the intelligent appliance do 
not require the use of a proprietary network control system or personal computer, however the 
subject invention is suited to communicate with a personal computer or proprietary network 
control system without detracting from the benefits discussed hereinafter. Furthermore, the 
skilled artisan will appreciate that a communication state of the inteUigent appliance includes 

20 information relating to past data of the intelligent appliance, such as a loss of power, time spent 
heating, average temperature and the like. In one embodiment, the present invention comprises 
an intelligent appliance, capable of communication directly with a remote device via any known 
form of electronic communications, including, but not limited to, infra-red, radio frequency, 
wireless or wired network communications protocols and the like. 

25 As will be understood by those skilled in the art, the inteUigent appliance system and 

method contemplated by the present invention is suitably adapted for use in both the residential 
and commercial environments. The skilled artisan will appreciate that both residential and 
commercial users are capable of utilizing the communications methods described herein. 

It will be appreciated that the system described herein is suitably used in conjunction with 

30 any wired or wireless network configuration. For example, alternate embodiments include use of 
networks configured using Wi-Fi (e.g., IEEE 802.x), infra-red, optical, radio frequency (RF), 
Powerline, Bluetooth technology and like. Furthermore, while the detailed embodiment 
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describes the application to an oven or other food preparation appUance, one skilled in the art 
will appreciate the application of the method and system described herein to other residential and 
commercial appliances, such as dishwashers, clothes washing machine, clothes dryer, and the 
like. 

5 Illustrated in Figure 1 is a simplified component diagram of one embodiment of an 

intelligent appliance communication system 100. As illustrated in Figure 1, the system 100 
generally includes an appUance side 105 and a remote or cUent side 110 of the system 100 
connected via a network 115. It will be understood by those skilled in the art that the network is 
any suitable network for electronic devices to communicate with each other as known in the art. 

10 For example, Ethernet, Token Ring, 802.x, Powerline, Bluetooth, infra-red, optical, radio 
frequency, or other standard is suitably adapted for use with the subject invention. It will be 
appreciated that the components described in the following embodiments of the system is 
suitably embodied within a computer, an appliance, a separate client, or a combination of these. 
In an embodiment, the appliance side 105 of the system 100 includes an intelligent 

15 appUance 120 having an appUance mechanism 125 suitably configured to perform a utility 
function (e.g., bake, refrigerate, refrigerate, wash, dry), a user-interface 180 providing display 
and programming options to a user, and an integrated controller, shown in Figure 1 as an 
embedded single board computer 130, configured to communicate with and process instructions 
received from the cUent side 110 of the system 100. In an alternate embodiment of the subject 

20 invention a controller, which has the abiUty to perform the appliance mechanism 125 fimctions 
of the intelligent appliance 120 is associated with, but not integrated into the intelUgent appliance 
120. The user-interface 180 includes, but need not be limited to a liquid crystal display (LCD) 
with or without touch-screen capabilities. The user-interface 180 is controlled by the embedded 
single board computer 130, and enables a user to view the program cooking instructions, set 

25 temperatures and the like. 

Providing connection between the gateway 140 and the intelligent appUance 120 are a 
physical layer 190 and a data transport layer 195. The skilled artisan will appreciate that the 
physical layer 190 is any suitable means for connecting the intelUgent appliance 120 to the 
gateway 140 or, alternatively to the modem 185, such as wireless, wired, power-Une, CAT5, or 

30 other physical connection media. The skilled artisan will fiirther appreciate that the data 
transport layer 195 is any suitable transport protocol capable of transporting datagrams between 

CLE 759595 J 
77414/33289 



electronic devices, such as hypertext transfer protocol, file transport protocol, real time transport 
protocol, or other suitable data transport protocol 

The embedded single board computer 130, includes means for communicating with the 
client side 110 of the system 100. For example, an integrated Ethernet, 10/100/1000 network 
5 interface card, wireless network interface card, a power-line interface card or the like, is suitably 
used to facilitate the connection to and communication over the network 115. Ahernatively, the 
intelligent appliance 120 suitably uses other means for communicating with the client side 110. 
For example, the appliance side 105, as shown in Figure 1, includes a power-line bridge 135 and 
a gateway 140 configured to facilitate connection to the network 115. 

10 To receive electronic messages, such as food preparation instructions from the client side 

110, the inteUigent appliance 120 has an assigned network address identifying the intelUgent 
apphance 120 on the network 115 to which other devices on the cUent side 110 transmits 
messages. For example, sending devices, such as a tablet 145B, a personal data assistant (PDA) 
150B, a web-enabled cellular phone 160B, and a personal computer 155B are illustrated. It will 

15 be appreciated by those skilled in the art that, when taking into consideration the method 
contained herein, the web-enabled cellular phone 160B is suitably a typical cellular telephone 
when combined with voice recognition software. Messages received by the intelligent appliance 
120, and more specifically, the embedded single board computer 130, are screened to determine 
if a received message originated fi-om an authorized sender. While the following example uses 

20 the electronic devices named above, those skilled in the art will appreciate that the present 
invention need not be limited to those items. Other personal electronic devices are suitably 
developed capable of accessing the Internet, communicating with other electronic devices or the 
like. Such personal electronic devices, it will be understood by those skilled in the art, are 
applicable to the subject invention. 

25 It will be appreciated that the intelligent appliance 120 is suitably viewed and controlled 

either locally 105 or across the network 115. For example, it will be appreciated that a tablet 
145A, a PDA 150A, a personal computer such as a laptop 155A, or a web-enabled cellular 
phone 160A, are suitably configured to wirelessly conmiunicate with the intelligent appliance 
120 through the apphance side 105 gateway 140 via communications channels 165, 167, 169 and 

30 170, respectively. As further shown in Figure 1, the tablet 145B or the PDA 150B or web- 
enabled cellular phone 160B, or personal computer 155B are suitably configured to 
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communicate with the intelligent appliance 120 through the remote side 110 via any suitable 
means to connect to the Internet 115 and thereby send and receive information from the 
intelligent appliance 120. 

hi one embodiment, the ability for the intelligent appliance 120 to communicate with a 
5 personal computers 155A, 155B, web-enabled cellular phones 160A, 160B, PDAs 150A, 150B 
and tablets 145 A, 145B, is facilitated by the different types of connections known in the art. For 
example, the intelligent apphance 120 is capable of integration into a structure that was 
constructed without pre-installed Ethemet wiring, using suitable altemate physical 
communication technologies, such as wireless 190 or powerline 135 in order to facilitate the 

10 connection. For this reason, the intelligent appliance 120 is suitably equipped with either 
wireless or power-line communication, or a combination of both forms, as is shown in Figure 1 
with reference to the physical transport layer 190. In an ahemate embodiment, the appliance 
side 105 conraiunicates with the remote client side 1 10 via a modem 185. It will be appreciated 
by those skilled in the art that the use of a modem enables the intelligent appliance to dial-up to 

15 the Intemet 1 15 without the need for the gateway 140. 

By using these technologies, intelligent appliance 120 easily connects into any local 
network. In addition, with the predominance of broadband intemet connections (DSL, Cable, 
ISDN, etc.) in residential and commercial facilites, access to appliances from a remote location is 
straightforward. 

20 In one embodiment, the inteUigent appliance 120 uses an extensible markup language 

(XML) communication protocol to transmit status data and operation instructions between the 
appliance side 105 and client side 110 of the system 100. It will be appreciated that the XML 
dialect is suitably transmitted over a variety of connections available. For example, the XML 
dialect is suitably transmitted using connections such as wireless and power-line technologies, as 

25 well as standard wire-line (e.g. directly connected Ethemet) technology and the like. While 
utilizing XML in this embodiment, one skilled in the art will appreciate that other 
communications languages are suitably used, including, but not limited to hypertext markup 
language (HTML), standard generalized markup language (SGML), Java, Python, JavaScript, 
ActiveX, or other web-based communications or programming languages. 

30 In accordance with the present system, an intelligent appliance 120 suitably 

communicates with sending devices 145A, 145B, 150A, 150B, 155A, 155B, 160A, 160B and 
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users in a variety of ways. It will be appreciated that an intelligent appliance 120 and 
specifically, the embedded single board computer 130, in accordance with the present system is 
suitably configured to use an open XML standard for communication. For example in a 
preferred embodiment, the present system uses Tonight's Menu Extensible Markup Language 
5 (TMXML), as an open XML standard. Therefore, software to view and control the operations of 
the appliance mechanism 125 is suitably easily crafted by one skilled in the art. 

Alternatively, an appUance mechanism 125 in accordance with the present system is 
suitably controlled through another XML protocol called voice extensible markup language 
(VXML). It will be understood that this voice protocol is suitably the standard language used by 
10 voice portals or systems. Further, it will be understood that by supporting VXML, Interactive 
Voice Recognition (IVR) systems are suitably constructed to enable users to obtain status and 
control the inteUigent appUance 120 from standard voice recognition devices (e.g. digital and 
cellular telephones). 

In accordance with an embodiment, the software for viewing and controlling the 

15 operations and status of the appliance mechanism 125 is contemplated to come in a variety of 
configurations for managing appliances 120. For example, the software is suitably available for 
Windows systems, PDAs (PocketPC and Palm OS), Linux, internet browsers, and other 
operating systems. Accordingly, the software suitably resides on the single board computer 130 
of the intelligent appliance 120. In an alternate embodiment, the software is suitably located on 

20 the personal computer 155 A, 155B, the PDA 150A, 150B, the tablet 145 A, 145B, or the web- 
enabled cellular phone 160A, 160B, and the intelligent appliance 120, which then suitably 
control the intelligent appliance 120 or view status information about the intelligent appliance 
120._ It will be appreciated that with the proper configuration, users can securely access 
intelligent appliances 120 from any location. Security features include an authentication 

25 challenge for accessing the inteUigent appliance 120 as well as encryption of the protocol during 
transmission to and from the intelligent appliance 120. 

In an altemate embodiment of the subject invention, the intelligent appUance 120 
comprises the components of Figure 1 enclosed in block 101. As shown, the intelligent 
appliance includes the gateway 140, the power-Une bridge 135, the modem 185, as well as the 

30 appliance mechanism 125 and the user interface 180. It will be appreciated by those skilled in 
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the art that such an embodiment is suitably incorporated into older buildings, lacking pre- 
equipped Ethernet or network capabilities. 

Referring now to Figure 2, there is shown an altemate embodiment of the intelligent 
appliance system of the subject invention. As shown in Figure 2, there is a system 200 
5 comprising a local side 206, a remote Internet connected side, shown in Figure 2 as an office 
202, and a web-enabled cellular phone 224B. The office side 202 includes an office network 
218, to which a user's personal computer 220B, PDA 228B and tablet 230B are connected. It 
will be appreciated by the skilled artisan that the user is able to suitably take the PDA 228A or 
the PDA 228B and exchange the relative positions without affecting the operation of the 

10 invention. For example, the user takes his or her PDA 228A fi-om the local side 206 to the office 
202. The same exchange is suitably performed with a web-enabled cellular phone 224A, 224B, 
tablet PC 230A, 230B, or personal computer 220A, 220B, e.g., a laptop computer. The user 
then, using a suitably adapted connection (i.e., Bluetooth, 802.x wired, etc.), accesses the local 
side 206 using the transported PDA 228 A firom the office side 202. It will fiirther be appreciated 

15 by those skilled in the art that the term local, as used with reference herein, is suitably used to 
identify a residential or commercial structure housing the intelligent appliance 234. 

It will be understood by those skilled in the art that the corporate firewall 216, which acts 
to protect the office network 218 fi-om unwanted intrusions from outside systems, such as over 
the connection 210 to the Internet 208, enables the personal computer 220B to access the Intemet 

20 208 without being subjected to unwanted access by other users outside the office network 218. 
Located at a site remote fi-om the office side 202, the local side 206 and the web-enabled cellular 
phone 224B are one or more servers 204, in communication with the local side 206, the office 
side 202 and web-enabled cellular phone 224B via the Intemet 208 over the server's connection 
212. To enable the communication between the web-enabled cellular phone 224B and the server 

25 204, communications signal 222 runs over a public switched cellular telephone network. 

While the system 200 uses a broadband Intemet connection 214A for connection of the 
local side 206 to the Intemet 208, it will be appreciated by those skilled in the art that a slower, 
public switched telephone network Intemet connection 214B, operatively connected to modem 
280, will also enable data transfer between the local side 206 and the Intemet 208. As is well- 

30 known in the art, data transfer over the public switched telephone network, known commonly as 
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"dial-up", is typically slower than broadband. Thus, the local side 206 is suitably equipped with 
broadband Internet access 214A using a gateway 226. 

As shown in Figure 2, the office network 218, the office connection 210, the server 
connection 212, and the local side connections 214A, 214B suitably comprise a physical layer 
5 290 and a data transport protocol 295. As will be understood by those skilled in the art, the 
physical layer 290 is any suitable means for connecting the intelligent appliance 234 to the 
gateway 226 or to the modem 280, such as wireless, wired, power-line, CATS, or other physical 
connection media. The skilled artisan will further appreciate that the data transport layer 295 is 
any suitable transport protocol capable of transporting datagrams between electronic devices, 

10 such as hyper-text transfer protocol, file transport protocol, real time transport protocol, or other 
suitable data transport protocol. 

It will be understood that the gateway 226 performs many network functions such as 
routing, firewall protection and Dynamic Host Control Protocol server. The Dynamic Host 
Control Protocol, or DHCP, server functions to automatically configure computers and other 

15 devices which use TCP/IP. While inbound information from the Internet 208 over broadband 
connection 214A is somewhat restricted by the firewall function of the gateway 226, outbound 
initiated communication is generally allowed which enables a user, a computer, or other device 
within the local side 206 to access the Intemet 208 easily. Such access is suited to occur 
through, but need not be limited to, communications using Network Address Translation. 

20 The local side 206 further includes an intelligent appliance 234 comprising an appUance 

mechanism 236, an embedded single board computer 238, a user-interface 246, and means for 
connecting to a network. The embedded single board computer 238 communicates with the 
appUance mechanism 236. In an alternate embodiment, the single board computer 238 is 
suitably associated with, but not integrated into, the intelligent appliance 234. In another 

25 embodiment it will be understood that the single board computer 238 suitably performs the 
appliance mechanism 236 functions of the intelligent appliance 234. In still another 
embodiment, the single board computer 238 is suitably configured to comprise communications 
components, known in the art, to communicate with a remote client via the Intemet 208. The 
single board computer suitably comprises an integrated network interface card to access the local 

30 network using a standard connection. The skilled artisan will appreciate that the standard 
Ethernet connection jack, the RJ45, is suitably used in those networks which are Ethernet based, 

CLE 7595953 
77414/33289 

-14- 



however, the subject application need not be limited solely to using Ethernet networking, but is 
readily adaptable to other networking configurations. The user-interface 246 is suited to 
comprise, but need not be limited to a liquid crystal display (LCD) with or without touch-screen 
capabilities. ^ 

5 In an alternate embodiment of the subject invention, the intelligent appliance 234 

comprises the components of Figure 2 enclosed in block 201. As shown, the intelligent 
appliance includes the gateway 226, the power-Une bridge 232, the modem 280, as well as the 
appliance mechanism 236 and the user interface 246. It will be appreciated by those skilled in 
the art that such an embodiment is suitably incorporated into older buildings, lacking pre- 

10 equipped Ethernet or network capabilities. It will also be appreciated by those skilled in the art 
that the single board computer 238 of the intelligent apphance 234 is suitably adapted to 
functioning as a server for other appliances. 

In the preferred embodiment, the appliance mechanism 236 of the intelligent appliance 
234 heats and cools food items. The embedded single board computer 238 further communicates 

15 with the appliance mechanism 236, thus, the embedded single board computer 238 is able to 
place the oven in cooking cycles, refngerate, perform self-cleaning and also retrieve sensor 
information from the appliance mechanism 236. 

The intelUgent appUance 234 is suitably configured to use DHCP to retrieve a dynamic P 
address or can be setup with a static IP address. This is configurable on the user-interface 246. 

20 The intelligent appliance 234 is suitably connected directly to the gateway 226 via the physical 
layer 290 within the residential or commercial structure. In an altemate embodiment, the 
intelligent appliance is bridged via power-line 232 or wirelessly to the gateway 226. 

As discussed with respect to Figure 1, control of the intelligent appliance 234 at the local 
side 206 is suitably accomplished by devices within the local environment, such as a personal 

25 computer 220A (i.e. laptop), a web-enabled cellular phone 224A, a PDA 228A, or a tablet 
computer 230A, or other electronic device. The personal computer 220A, the web-enabled 
cellular phone 224A, the PDA 228A and/or the tablet computer 230A, communicate(s) with the 
intelligent appliance 234 through the gateway 226 via communications channels 242, 244, 246 
and 248, respectively, or directly with the intelligent apphance 234 via the single board computer 

30 238. The skilled artisan will appreciate that the local side 206 of Figure 2 and the appliance side 
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105 of Figure 1 function in much the same manner and need not be readdressed herein. 
However, the use of additional components of the system 200 will now be discussed. 

In this alternate embodiment, the intelhgent appliance 234 will proactively establish 
outbound internet connections to one or more servers 204. The server 204 is suitably physically 
5 located at the appliance 234 manufacturer's facilities or securely residing at designated Co- 
Location facilities. The purpose of this is to allow communication to the intelligent appliance 
234 by first establishing an outbound connection 214A or 214B from the local side 206. The one 
or more servers 204 act as an authentication mechanism and a conduit that will allow a user to 
easily communicate with the intelligent appliance 234 via the Internet 208 over the server 

10 connection 212. 

The one or more servers 204 accept the connection from the local side 206 and 
authenticate the intelhgent apphance 234 as a vahd apphance. It will be appreciated that such 
communications are suited to include, but need not be limited to Hyper Text Transfer Protocol 
(HTTP) and XML payloads to authenticate and validate the intelligent appliance 234. Upon 

15 validation of the intelligent appliance 234, the connection will remain estabUshed, but inactive 
until such time as either the intelligent appliance 234 or the server 204 terminate the connection, 
or go active when the user is ready to communicate with the intelligent appliance. 

Once the intelligent appliance 234 is in communication with the server 204, a user 
communicates directly with the intelligent appliance 234 through the server 204. The 

20 communication between the user and the intelligent appliance 234 via the server 204 is suitably 
accomplished through several different methods. For example, a user at his or her office 202 
runs a web browser on the personal computer 220B and access the server 204 via the Intemet 
208. The user-interface 246 of the intelligent appliance 234 is then displayed on the browser at 
the personal computer 220B. The web application then prompts the user to authenticate himself 

25 or herself Upon authentication, the server 204 will establish a data communication channel with 
the user at the office side 202 and pair up the user with his or her intelligent appliance 234, All 
communication between the user and the intelligent appliance 234 passes through the server 204 
using Intemet connections 210, 212 and 214A or 214B. In this embodiment, the server 204 acts 
as a conduit delivering data back and forth between the intelligent apphance 234 and the user at 

30 the personal computer 220B. One skilled in the art will recognize that the sending devices such 
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as tablet 230B or a personal data assistant 228B are suitably used in the place of the personal 
computer 220B. 

It will be understood by those skilled in the art that the preceding example also is 
accomplished using the web-enabled cellular phone 224B in place of the personal computer 
5 220B. In this alternate embodiment, the server 204 is suitably equipped with telephony 
equipment to accept inbound voice communications via connection 222. An IVR system 
provides the user with the capability to manage the intelligent appliance 234 from the web- 
enabled cellular phone 224B. Such management typically will require the user to first 
authenticate himself or herself Phone number detection and Automated Speech Recognition 

10 (ASR) will assist the user in the authentication process. Once authenticated, the IVR session 
with the user will be linked to the intelligent appliance 234 via connection 222 from the phone 
224B to the server 204 and connections 212 and 214A or 214B, from the server 204 to the 
Internet 208 to the local side 206. 

The operation of the present system and various components will be better understood by 

15 referencing Figure 3 through Figure 17. The illustrated elements in the Figures denote steps and 
represent instructions or groups of instructions that cause a processor, mechanism, or other 
device to perform a ftmction, an action, and/or to make a decision. 

Alternatively, the steps represent fiinctions and/or actions performed by fimctionally 
equivalent circuits such as a digital signal processor circuit, an application specific integrated 

20 circuit (ASIC), or other logic device. The diagram, as well as the other illustrated diagrams, does 
not depict syntax of any particular programming language. Rather, the diagram illustrates 
functional information one skilled in the art could use to fabricate circuits, generate computer 
software, or use a combination of hardware and software to perform the illustrated processing. It 
will be appreciated that electronic and software applications involve dynamic and flexible 

25 processes such that the illustrated steps can be performed in other sequences different than the 
one shown and/or steps are suitably combined or separated into multiple components. 

With reference to Figures 3 through 17, the methodology will be described with reference 
to an intelligent refrigerator/oven having a built-in bi-directional Intemet communications 
system. Although, the embodiments of the present system will be described in connection with 

30 an intelligent refiigerator/oven having a built-in bi-directional Intemet communications system, 
it will be appreciated that the methodology described herein is suitably applicable to other 
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appliances and apparatus without departing from the scope of the invention. For example, the 
system described herein is suitably applicable to household or commercial 
clothes washing machines, clothes drying machines, dish washing machines, security systems, 
automobiles, health care equipment and instrumentation, manufacturing machinery and the like. 

5 Illustrated in Figure 3 is one embodiment of a methodology 300 associated with the 

appliance discovery process. Upon power up, the intelligent appUance 120 initializes its 
communications subsystem. Concurrently, the cUent side of the subsystem is suitably configured 
to perform two routines. Specifically at step 310, the remote or client side of the system prompts 
users for IP address and port identification information for a specific appliance. Additionally, 

10 the remote or client side of the system sends a broadcast network message seeking a network 
connected appliance 320. 

Illustrated in Figure 4 is one embodiment of a methodology 400 associated with the 
appliance discovery process from the client side (e.g., cellular phone) of the system. Upon 
commencing the discovery process and as previously described, the system has prompted the 

15 user for appliance information at 310. The system has also sent a broadcast discovery message 
seeking a network appliance at 320. It will be understood that these discovery processes are 
suitably automatic or manual processes. As well, the processes are suitably programmed or pre- 
programmed by a user. 

With continued reference to Figure 4, upon sending a broadcast message seeking a 

20 network appliance 420, the system pauses for a user selected period of time for a response from 
the appUance at step 430. In the event that a response is received from an appliance as 
determined at step 435, the system proceeds by displaying a list of available appliances to the 
user at step 440. The system then progresses to step 450, where a transmission control protocol 
(TCP) connection to the appliance is estabUshed. However, when no response is received from 

25 the appliance at step 435, the system progresses to step 445, wherein the broadcast is terminated 
and an error signal is transmitted back to the user. It will be appreciated by those skilled in the 
art that the error signal is suitably comprised of an appliance not found signal, an appUance off 
signal, or the like. 

Whether the user is prompted for appliance information 410 or the user receives the 
30 appliance information as a result of a broadcast request 440, the system establishes an operable 
TCP connection to the selected appliance 450. 
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Subsequently, the client transmits a connection request with optional credentials for 
authentication purposes at step 460. It will be understood by those of ordinary skill in the art that 
any security authentication procedure is suitably used. As well, the system is suitably configured 
without any necessary authentication parameters. 
5 In the instance that authentication is desired or has been implemented, the system 

determines at step 470 if the credentials supplied are authentic. In the event that the credentials 
are not sufficient for authentication, the system returns an error notification to the user at step 
480. Alternatively, when the credentials are sufficient for positive authentication, the details of 
the appliance are transmitted back to the user at step 490. 

10 Illustrated in Figure 5a and 5b are embodiments of a methodology associated with the 

appliance, waiting for broadcast and waiting for connection, respectively, discovery process from 
the appliance side of the system. Initially, at 510, the appliance side subsystem listens for 
broadcast discovery messages on the network. These broadcast messages are suitably sent out 
by clients looking for network connected apphances. Upon receiving a discovery message at 

15 step 520, the appliance responds with a series of identification messages at step 530. The 
contents of the identification messages suitably include an XML document that describes the 
following: 

Name of AppUance 
20 Description 
Manufacturer 
Model 

Serial Numbers 

IP Address and Port number for connections for commands and status 

25 

Other information regarding the appUance is contained in the identification messages transmitted 
at step 530. One skilled in the art will appreciate the content includes, but is not limited to the 
above-identified information. 

Next, the system is suitably configured to repeat the process by waiting for additional 
30 broadcast messages looking for appliances by returning to step 510. Once identifying 
information is received from the appliance, this information is stored and/or used by the cUents 
to initiate a connection to the appliance. 

It will be appreciated that client software packages need not proactively transmit 
discovery broadcast messages before establishing a connection to an appUance. This step is 
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optional and is suitably used to automatically discover which appliances are available. It will be 
appreciated that the client software is suitably programmed or pre-programmed with appliance 
identifying information. If the client software is programmed or pre-programmed with the 
details of an appliance (e.g., the IP address and port number), the cHent automatically connects to 

5 the appliance without having to transmit any discovery messages. Likewise, client software can 
prompt the user to program all of the appliance details instead of performing discovery. It will 
be understood that these optional configurations are suitably appropriate in the event that the 
client software is behind a firewall or residing on a different network. 

Figure 5b illustrates an alternate embodiment of the series of connection and 

10 authentication procedures of the remote client from the appliance side of the system. Initially at 
step 540, the appliance waits for a connection to be made from a client. Once the client software 
is ready to initiate a connection to an appUance, the appliance attempts to make a socket 
connection to the apphance on the advertised IP address and port number of the appliance at step 
550. 

15 Upon connection, the client transmits an XML document to the appUance. This 

document contains information indicating the client's intent to connect to the appliance along 
with optional authentication credentials at step 560. It will be appreciated that the user is capable 
of defining if authentication of the client is desired. 

In the event that the appliance is programmed or pre-programmed to perform 

20 authentication and the supplied credentials 570 fail, then an authentication error message is 
returned to the client and the connection is terminated at step 580. When no authentication is 
required at step 560 or when the client's credentials are successfiilly verified, the appliance 
transmits, at step 590, an acceptance message containing the same information found in the 
discovery message as described above. Sending this detail information enables the client 

25 application to update any of the appUance information previously retrieved, used or stored. The 
appliance then returns to listen for requests from a cUent at step 540. 

Referring now to Figure 6, there is illustrated an example of the process of attaching an 
appliance as viewed from the client side. The process begins at step 610, where the client 
broadcasts a request for connection information of a particular appliance. The process proceeds 

30 to step 620, where a determination is made that no connection information has been received. 
An error message is displayed to the user at step 630 and the process ends. 
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In the event that connection information is received at step 620, the client connects to the 
appHance using the IP address and port information returned at step 640 in response to the 
connection information request of step 610. The client then transmits a login request with 
optional authentication credentials to the appliance at step 650. Along with the login request, a 
5 status update rate request is transmitted by the client. When the appliance determines at step 660 
that the authentication attempt failed, an error is displayed to the user at step 680 and the process 
terminates. Altematively, when the authentication information transmitted from the client to the 
appliance is verified at step 660, the appliance is ready to receive management instructions from 
the cUent at step 670. 

10 It will be appreciated that the process for attaching an appliance to a client, as described 

above, pertains equally to both the client and the appliance. Thus, one skilled in the art will 
appreciate that the process and instructions transmitted and received are equivalent and need not 
be rewritten herein. 

Figures 7 and 8 illustrate the methodology of sending commands and status updates once 
15 a client has been successfully attached to an appliance. 

Each appliance contains a list of well known commands. For example, often times these 
include button presses and operations such as set time or set temperature. For an oven, the set of 
commands consists of an actuation of a physical button on the control panel of the oven such as 
bake, broil, cool, start, cancel and the like. One skilled in the art will understand that the 
20 intelligent appliance is also capable of performing high level operations, such as running a 
program that will cook a dish to be done at a certain time in addition to running operations by a 
simple keypress. 

It will be appreciated that the client software user interface includes a graphical user 
interface (GUI) that mimics the appearance of the physical appliance allowing the user to click 

25 or press buttons on the desktop. With reference to Figure 7, upon pointing and clicking on the 
specific button, the command side of the system accepts a user identified keypress at step 710. 
Next, the user interface command is encoded and translated into an XML command to be sent to 
the appliance at step 720. At step 730, the client side of the system builds the keypress request 
into a packet and transmits the information to the appUance. It will be appreciated by those 

30 skilled in the art that the packet is any suitable packet capable of transmission over a computer . 
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network, thereby utilizing the communications protocol (e.g., IP, FTP, HTTP, or the like) 
associated with the type of network over which transmission will occur. 

Figure 8 illustrates the appliance command send methodology from the appliance side. 
As shown, the appliance waits for a keypress message from the established client connection at 
5 step 810. Once received, the appliance side of the system decodes the keypress message 
contained within the packet at step 820. In accordance with the message sent and subsequent 
decoding, the appliance initiates the corresponding keypress to effectuate the user command at 
step 830. As the intelligent appliance is in continuous communication with the remote user, the 
appUance returns to wait for an appliance keypress from the established coimection at step 810, 

10 Figures 9 and 10 illustrate the dish management of the apphance from the client 

perspective, and the appliance perspective, respectively. 

Referring first to figure 9, there is depicted the client side of the dish management 
methodology of the subject invention. The user is presented with four choices regarding the 
management of dishes by the appUance at 910. The client initiates all the dish operations by 

15 sending an XML document with one of four dish commands: retrieving a list of available dishes, 
deleting a dish, adding a new dish, or modifying an existing dish. First, the user suitably 
retrieves the list of dishes by transmitting a get dish request at step 920. The client then 
transmits the request to the appliance at step 925 and waits for the appliance to respond. The 
response is then parsed and dishes and steps involved in the dishes are generated into a hst for 

20 the user at step 930. 

Returning to 910, the user suitably selects to remove a dish previously created. At step 
935, the user identifies a dish from a Hst of dishes to remove from the available dishes. The 
chent then constructs and transmits a delete dish request to the appliance at step 940. The user 
desires, at 910, to add a new dish to the stored dishes. The client then identifies dish information 

25 at step 945. The dish information includes numerous steps or phases. Steps include 
refiigeration, bake, convection bake, broil or warm. Ovens are capable of storing the cooking 
steps for various dishes. A step consists of a method for cooking (bake, convection, etc), a 
temperature and duration or probe temperature. The collection of steps, along with some 
descriptive information, constitutes the definition of a dish. For example, the collection of steps 

30 suitably comprise a special series of state commands. Thus a "Sabbath" mode is initialized, 
wherein the special series of commands includes commands for the intelligent appliance 120 to 
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turn-off all lights, maintain a constant temperature, mute all audiblizations, or the like Another 
example of a special series of state commands includes commands for the intelligent appliance 
with respect to commercial usage, such as in a restaurant, hotel, bakery or the like. The 
restaurant owner desires to begin the preparation of a dish before the first employee arrives in the 
5 moming. The owner initiates a suitable mode wherein the intelligent appliance preserves a food 
item in a refrigerated state for a period of time, (i.e., overnight) and heats the dish for completion 
as the first employee arrives in the moming, readying the dish for sale. Such a restaurant mode 
enables the owner to halt the intelligent appliance from a remote location in the event that no one 
will arrive at the time given, or reschedule the finish time to coincide with a late arriving 
10 employee. 

Returning to Figure 9, the client then generates a new dish request and transmits the 
request to the appliance at step 950. The user desires to modify a dish already in the available 
list of dishes at 910. Accordingly, the client identifies dish information, including steps, name 
and description at step 955. A modify dish request is then transmitted to the appliance at step 

15 960. Irrespective of the operation identified by the user, the definitions of dishes are stored on 
appliances and are managed remotely by the client. 

Referring now to Figure 10, there is depicted the appliance side of the dish management 
methodology of the subject invention. Beginning at step 1010, the appliance is in a state of 
waiting for management instructions or requests from the client. When a dish management 

20 request is received, the appliance determines the task requested at step 1015. Upon the 
determination that a list of dishes is requested, the appliance will access local or remote storage, 
and retrieve a list of all dishes available at step 1020. The appliance will then generate an XML 
document in response to the request, including a listing of all dishes that are defined on the 
appliance at step 1025. The information for each dish will include items such as name, 

25 description, unique dish ID, and a list of cooking steps. The appUance system retums to wait for 
additional Dish Management requests 1010. 

Upon the determination at 1015 that the client has requested to delete a dish, the 
appliance proceeds to step 1030, where the target dish is located within the list of dishes defined 
on the appliance. The dish is then deleted, or removed, from the list of definitions on the 

30 appUance at step 1035, then retums to a waiting state at step 1010. In order to be certain that the 
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proper dish is deleted, the XML document containing the deletion request also contains an 
unique dish identification, thereby preventing the unwanted deletion of a dish. 

Returning to step 1015, the determination is made that the request from the cHent is an 
add dish request. The appliance then generates a dish record at step 1040. The dish record 
5 incorporates all the dish definition information needed. The information includes, but need not 
be limited to numerous steps or phases. Steps include refrigeration, bake, convection bake, broil 
or warm. Ovens can store the cooking steps for various dishes. A step consists of a method for 
cooking (bake, convection, etc), a temperature and duration or probe temperature. The collection 
of steps, along with some descriptive information, constitutes the definition of a dish. The dish 
10 information is then stored into the list of available dishes at step 1045. Following the storage of 
the dish information at step 1045, the system retums to step 1010 to await fiirther dish 
management requests. 

Upon the determination at step 1015 that the request received from the client directs the 
appUance to modify an existing dish, the appliance locates the target dish in a list of available 

15 dishes defined on the appliance at step 1050. Dishes are suitably modified by sending an XML 
document to the appliance containing the dish modify command, the imique dish ID to be 
modified, and the new dish definition. The appliance then replaces the contents of the dish 
information with the new information sent in the XML document containing the dish modify 
request at step 1055, then retums to step 1010 to wait for fiirther requests from the client. One 

20 skilled in the art will appreciate the use of XML documents is exemplary in nature and the 
management and control of the appliance from a client is suitably accomplished using other 
suitable languages. 

Figures llA through 12B illustrate the methodology of programming a dish for cooking 
once a client has defined a dish to an appliance. In addition to storing and understanding the 
25 definition of dishes, the appliance also is suitably equipped to execute steps for cooking a dish. 
The inteUigent apphance of this embodiment need only ascertain the dish to cook and the time at 
which the dish should be ready for consumption. The typical steps for cooking a dish are the 
following: 

30 Start by refiigerating the dish for a period of time 

This is followed by the cooking phase (bake, convection bake, broil) 
Keep the dish warmed for a period of time 
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Start refrigeration after the warming phase if the program has not been canceled 

Figure llA illustrates the methodology, as viewed by the client, for programming the 
appliance. The client awaits the selection by the user of the desired dish at step 1 105. It will be 
5 apparent that the dish selected will be stored, either on a server accessible to the appliance, the 
chent or the appliance itself The user must then select, at step 1110, the finish time for the dish, 
e.g., when the user would like to consume the prepared dish. The client software will then, based 
upon the programmed steps and the selected finish time, calculate a start time at step 1115. 
When a determination is made at step 1 120 that the start time has already passed, the client will 

10 inform the user that there is not enough time to cook the dish at step 1 130. When, however, the 
determination at step 1 120 is made that the start time is after the current time, the program dish 
conmiand is sent to the apphance along with the unique dish E) and the finish time at step 1 125. 

Figure IIB illustrates an altemate methodology, as viewed by the client, for 
programming the appliance using an appliance probe. It will be appreciated by those skilled in 

15 the art that the reference to an appliance probe includes, but need not be limited to a thermometer 
inserted into a dish, a thermo-sensing device capable of ascertaining the internal temperature of a 
food, a thermal imaging device with similar capacities, or the like. The use of a temperature 
probe inserted into a dish is for exemplary purposes only and the skilled artisan will appreciate 
other techniques and devices are suitably used to ascertain information regarding a dish. The 

20 client awaits the selection by the user of the desired dish at step 1135. It will be apparent that the 
dish selected will be stored, either on a server accessible to the appliance, the cUent or preferably 
the appliance itself. The user is then prompted to input the internal temperature at which the dish 
is to be considered done, e.g., cooked, the approximate amount of time needed to cook the dish 
and the oven temperature at step 1140. Altematively, at step 1140, the approximate amount of 

25 time needed to cook the dish is suitably calculated by entering the weight of the dish, in addition 
to the probe temperature and the oven temperature. For example, a user inputs a desired probe 
temperature of 170 degrees Fahrenheit, a dish weight of five-pounds and an oven temperature of 
325 degrees Fahrenheit, then the approximate cooking time of the dish is calculated to be 35-40 
minutes. In using a probe, the appliance is suitably equipped to determine the end of the cook 

30 cycle based on the internal temperature of the dish itself, particularly meats, and not just a 
specific time to cook the dish. The user must then identify, at step 1 145, the finish time for the 
dish, e.g., when the user would like to consume the prepared dish. 
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After inputting the desired internal temperature and the approximate cooking time or food 
weight and oven temperature, the client software will, based upon the programmed steps and the 
selected finish time, calculate a start time at step 1 150. In the event that a determination is made 
at step 1155 that the start time has already passed, the client will inform the user that there is not 
5 enough time to cook the dish at step 1165. When, however, the determination at step 1155 is 
made that the start time is after the current time, the program dish command is sent to the 
appliance along with the unique dish ED and the finish time at step 1 160. 

Referring now to Figure 12 A, there is shown the methodology of programming a dish for 
cooking from the appliance side of the system. The appliance waits for an appliance program 

10 dish message from the connection previously established between the remote client and the 
appliance at step 1202. Upon the receipt of a program dish command from the remote client, the 
appliance initiates the programming of a dish at step 1204. A cooking method for the current 
cooking step on the appliance is then stored at step 1206. Cooking methods include, but are not 
limited to, freezing, cooling, baking, broiling, warming, roasting, and the like. The appliance 

15 then stores the temperature for the current cooking step at step 1208. Temperature settings, as 
instructed by the dish, vary from heating at high temperatures to cooling at lower temperatures. 

The appliance then determines, at step 1210, that the cooking step currently being stored 
is not the first cooking step to be programmed. Upon such an occurrence, the appliance then 
stores the appropriate start time for the current cooking step at step 1212. With the start time for 

20 the current cooking step programmed, the end time for the current cooking step is stored at step 
1218. Returning to step 1210, a determination that the current cooking step is in fact the first 
cooking step leads the appUance to step 1218, where the end time for the current cooking step is 
to be programmed. 

Irrespective of whether or not the current cooking step is the first step, or simply another 
25 in a series of cooking steps, following step 1218, the appliance must determine if the current 
cooking step is the last, or final, cooking step in the dish at step 1216. When the current cooking 
step is determined, at step 1216, to not be the last step, the appliance moves on to program the 
next step, at 1214, and proceeds to retum to step 1206, where the cooking method for the next 
step is to be programmed. 

30 In the event that the current cooking step is actually the last, or final step in the dish 

program, the appliance proceeds to initiate the start of the programming at step 1220 and retums 
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the appliance to step 1202. It will be appreciated by those skilled in the art that the 
communications module of the appliance will relay the specifics of each programmed cooking 
step to the control module of the appliance mechanism. 

Referring to Figure 12B, there is shown an alternate methodology of programming a dish 

5 for cooking by the appliance side of the system making use of an appliance probe. The appliance 
waits for an appliance program dish message from the connection previously established 
between the remote client and the appUance at step 1222. Upon the receipt of a program dish 
command from the remote client, the appliance initiates the programming of a dish at step 1224. 
A cooking method for the current cooking step on the appliance is then stored at step 1226. 

10 Cooking methods include, but need not be limited to, freezing, cooling, baking, broiling, 
warming, roasting, and the like. The appliance then stores the temperature for the current 
cooking step at step 1228. Temperature settings, as instructed by the dish, vary from heating at 
high temperatures to cooling at lower temperatures. 

The appliance then proceeds to make a determination at step 1230 that the recently stored 

15 step does not have a probe temperature, i.e. the step doesn't require the probe to be used to gather 
the temperature of the dish during the step. Once the determination is made at step 1230 that the 
probe is not required, the end time for the current step must be stored at step 1232. 

Retuming to step 1230, the determination is made that a probe temperature is required in 
the step. A probe temperature, i.e., the internal temperature to which the dish should be cooked, 

20 is stored at step 1234 along with the weight of the dish in order to estabUsh the end time for the 
current step. 

Irrespective of whether or not the current cooking step is the first step, or simply another 
in a series of cooking steps, following either step 1232 or step 1234, the appliance must 
determine if the current cooking step is the last, or final, cooking step in the dish at step 1236. 
25 When the current cooking step is determined, at step 1236, to not be the last step, the appliance 
moves on to program the next step at 1238, and proceeds to return to step 1226, where the 
cooking method for the next step is to be stored. 

In the event that the current cooking step is actually the last, or final step in the dish 
program, the appliance proceeds to initiate the start of the program 1240 and retums the 
30 appliance to step 1222. It will be appreciated by those skilled in the art that the communications 

CLE 7595953 
77414/33289 

-27. 



module of the appliance will relay the specifics of each programmed cooking step to the control 
module of the appliance mechanism. 

Figures 13 and 14 illustrate the methodology of updating the status of the appliance fi^om 
both the remote or client side and the appliance side. It will be appreciated that the status 
5 messages are suitably sent from the appliance either automatically or at a pace dictated by the 
client or at the request of the cUent. For example, desktop software that resides on a computer in 
a residential or commercial structure desires rapid status updates (e.g., 5-10 times per second) 
while a PDA user operating over the intemet desires updates (e.g., 2-4 times per second). One 
skilled in the art will appreciate that the refresh rate on status updates for the appliance is 

10 discretionary and is suitably changed in accordance with the user's selections, hi addition, some 
users desire to request updates as needed, e.g., wireless data phones or controlling the appliance 
via telephone, rather than receiving automatic updates. The skilled artisan will appreciate that 
the transmission rate varies in accordance with the type of apphance, the amoimt of information 
and the types of networks over which the data is transmitted to the client. It will also be 

15 appreciated that the content of the status message will vary in accordance with the type of 
appliance. The general format is the same, but the specifics will differ for various appliances. 
For example, an oven would typically contain the following: 

The current oven temperature 
20 The probe temperature of the dish 

The clock status (cooking time and/or clock time) 
Mode of the oven (cool, bake, broil, etc) 

Whether or not the oven is in program mode and what step/phase it is in 
Status of various indicators or LED on the oven display 

25 

Tuming to Figure 13, there is shown the status update procedure for the appliance from 
the remote or client side. The client waits, at step 1310, for an appliance status update message 
transmitted firom the appliance. It will be appreciated by one skilled in the art that while this 
embodiment uses a user datagram protocol, or UDP, packet to contain the status update message, 
30 the application of the present invention need not be so limited, as other connectionless or 
connection oriented data transmission protocol packets are also acceptable. 

Upon receipt of the status update message, the client decodes the appliance status update 
packet codes at step 1320. The client will take the status messages and, at its discretion, relay 
the information to the user through its user interface. At step 1330, display elements on the 
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appliance are turned on or off, thereby "illuminating" or updating corresponding screen 
components of the appliance to visually show the user appliance status. The list of connected 
users received in the status message is subsequently stored at step 1340, It will be appreciated 
that the display referenced above need not be limited to the visual spectrum, but further include 
5 audiblizing the appliance status to the user. 

Figure 14 illustrates the appliance status update on the appliance side. Beginning in a rest 
state at step 1410, the appUance rests for a predetermined amount of time. For example, for 
every second, a fraction of a second is spent in sleep mode. In one embodiment, the amount of 
time spent in sleep mode at step 1410 is a fraction of second as identified by the user. Upon 

10 awakening, the appliance determines at step 1420 that based on the client selected update rate, no 
status update should be sent to the client. The appliance then returns to rest at step 1410. 

In the event that at step 1420, it is determined that a status update message should be sent 
in accordance with the client update rate, the appliance creates a status display message at step 
1430. The status display message includes, but need not be limited to display information and 

15 connected users. Once the status display message has been generated, the appliance transmits 
the status update message in a packet to the client at step 1440. For the present embodiment, the 
communications protocol used to transmit the message is a user datagram protocol packet. 
However, it will be understood by those skilled in the art that the communications protocol is 
any suitable connectionless or connection oriented communications protocol and the subject 

20 invention need not be limited to the user datagram protocol. Once the status update message has 
been sent, the appliance retums to resting for the predetermined period of time 1410. 

Figures 15 and 16 illustrate embodiments of a methodology for the cUent side of the 
appUance diagnostics procedure and a methodology for the appliance side of the appliance 
diagnostics procedure, respectively. Remote diagnostics are capable of being performed upon 

25 the request of a chent as a result of the incorporation of remote communication abilities. 

Referring first to Figure 15, there is shown a procedure for initiating the remote 
diagnostics of an appliance by a remote client. The client generates a diagnostics request to be 
sent to the client at step 1510. The diagnostic request includes, but is not limited to tests on the 
refrigeration unit, the heating elements, the power subsystem, the control module, and various 

30 safety subsystems in the appliance. The client then waits for a response from the appliance at 
step 1520. The skilled artisan will appreciate that the period of time for waiting before 
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retransmitting the diagnostics request is suitably predetermined in accordance with the client 
directives. After receiving an XML document containing the diagnostics information requested, 
the results are parsed and the NameA^alue pairs are pulled out of the list at step 1530. The user 
is presented with the diagnostic results at step 1540. 
5 Turning now to Figure 16, there is represented a procedure for processing a diagnostics 

request received from the cUent or automatically initiated by the appliance. The appliance waits 
for a diagnostic request to be processed at step 1610. This waiting allows the appliance to 
determine the extent or level of depth required by the request and prepare the appliance for 
carrying out the request. The appliance then, at step 1620, proceeds through each subsystem and 

10 collects a list of NameA^alue pairs. When diagnostics is requested by the client software via a 
perform diagnostics command, the apphance will inspect the request for the diagnostics level and 
then initiate a series of diagnostic tests on its various subsystems. This includes, but need not be 
limited to, tests on the refrigeration unit, the heating elements, the power subsystem, the control 
module, and various safety subsystems in the appliance. 

15 The diagnostic results from each subsystem are aggregated into an XML response 

document at step 1630. The appliance will then generate a diagnostics response using the XML 
results document and transmit those results to the client at step 1640. This form of remote 
diagnostics allows service centers to perform initial tests on appliances without having to make a 
trip to the appliance site. Initial diagnosis can be made and parts ordered/collected before 

20 visiting residential or commercial location for repair. 

Li an alternate embodiment, the appliance initiates the diagnostics request. For example, 
when safety alarms (e.g., high temperatures, power fluctuations, internal combustion, fire, or the 
like) trigger or faults in subsystems are identified, the appliance performs various levels of self 
diagnostics and send a message to the owner or a service center. This message is sent to the 

25 client or service center in a variety of different manners, including, but not limited to email, 
SMS, HTTP, direct socket connections, or the like. Certain alarms are also tied into a local 
security system so that specific critical alarms generate security alerts to monitoring companies 
to immediately contact the appliance owner or alert the fire department and/or police. 

Figure 17 illustrates a methodology for controlling an appliance using voice commands 

30 from a remote location. Interactive Voice Recognition (IVR), or voice portals, enable systems to 
be controlled through voice conmiands. VXML allows systems to outline and describe call 
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flows that a voice portal or an IVR system would follow for the user. The voice portal plays pre- 
recorded audio files or employs text-to-speech (TTS) technology to convert standard text to 
spoken works. Voice portals also allows user to speak selections or responses in addition to the 
pressing of buttons (also know as Dual Tone Multi-Frequency or DTMF). The speech 

5 recognition technology is known as Automated Speech Recognition (ASR). 

Referring to Figure 17, the procedure initiates with a user calling into a voice portal at 
step 1710. Using one of the above-identified technologies, the voice portal would welcome the 
user and query the user for a usemame, e.g., telephone number, at step 1720. This is spoken or 
entered fi*om the phone keypad. Each key on a touch-tone phone correlates to a different 

10 frequency. The frequencies represent numbers or letters, as directed by the receiving device. 
After retrieving the usemame, the user is prompted for a password at step 1730. For example, a 
numeric PIN is suitably used because a PIN is easily entered or spoken on a phone. 

A determination is made at step 1740 that the password entered by the user is invalid and 
the system retums to step 1710 for a second attempt. In the event that the additional two 

15 attempts to enter the correct password have failed at step 1770, the error is reported to the user 
and the call is terminated at step 1780. When a user has correctly entered and authenticated 
password at step 1740, the details of the appliances are retrieved by the voice portal and are used 
to connect to the appliance at step 1750. Commands, management and diagnostics are then 
performed by the voice portal interacting with the appUance through VXML using HTTP for 

20 transmission at step 1760. The voice system facilitates the interaction by using DTMF and ASR 
to retrieve information and requests from the user and pass that along to the appliance. The 
voice system then takes resulting VXML from the appUance, invokes any necessary TTS and 
presents the resulting audio to the caller. Thus, a user is provided with the ability to control and 
manage an appliance with ease from a variety of remote locations. 

25 While the present invention has been illustrated by the description of embodiments 

thereof, and while the embodiments have been described in considerable detail, it is not the 
intention of the applicants to restrict or in any way limit the scope of the appended claims to such 
detail. Additional advantages and modifications will readily appear to those skilled in the art. 
Therefore, the invention, in its broader aspects, is not limited to the specific details, the 

30 representative apparatus, and illustrative examples shown and described. Accordingly, 
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departures are suitably made from such details without departing from the spirit or scope of the 
applicant's general inventive concept. 
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